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Abstract. We consider the family of Rankin-Selberg convolution L-functions of a fixed 
SL(3, Z) Maass form with the family of Hecke-Maass cusp forms on SL(2, Z). We estimate 
the second moment of this family of L-functions with a "long" integration in i-aspect. These 
-L-functions are distinguished by their high degree (12) and large conductors (of size T 12 ). 



1. Introduction 



OS , In this paper we study the second moment of the Rankin-Selberg L-functions L(<ft x Uj, | + 
it) of a fixed Hecke-Maass form on SL(3, Z) convolved with the family Uj of Hecke-Maass 
cusp forms on SL(2, Z) as well as with the twists by n %t . This family is "large" as measured in 
a variety of ways: there are T 3 elements in the family, each having degree 12 and conductor 
of size T 12 . For comparison, the classical large sieve can estimate the eighth moment of the 
family of classical Dirichlet L-functions of modulus q < Q (having Q 2 elements of degree 8 
and conductors of size Q 8 ). The various GL(2) large sieve type inequalities also generally 
allow for degree 8 L-functions with similarly-sized conductors, so that one can make a case 
that this family is significantly larger than others appearing in the literature. For use in 
applications, it is highly desirable to have control over large families of harmonics, as they 
produce stronger detectors of arithmetical functions; see the introduction of [DuIJ. 

Another way to motivate interest in this particular family is that the first moment (at 
the central point s = 1/2) was recently used by X. Li [Lilj |Li2] to show subconvexity for a 
self-dual GL(3) L-function in t-aspect (amongst other things). The self-duality is crucially 
used to impose nonnegativity of the central values. In order to use moments to study 
non-self-dual forms, as well as Rankin-Selberg convolutions at points other than s = 1/2, 
J> ! it seems necessary to study the second moment. However, this approach has substantial 
new difficulties. In particular, the second moment of this family at the central point has 



prohibitively large conductors (of size T compared to T elements in the family, a sixth 
power). However, one can enlarge the size of the family without substantially growing the 
size of the conductors by twisting by n lt with t almost as large as the spectral parameter. 
This procedure then brings the problem into the presumably more feasible range where the 
conductor is the fourth power of the size of the family. Even so, the conductors of the 
family are still very large so that estimating this moment requires a substantial amount of 
cancellation. In fact, the main difficulty is showing simultaneous cancellation in the twists 
by the Hecke-Maass forms as well as by n lt . Many of the methods in the literature used to 
show cancellation in the Maass form aspect are incompatible with the t-aspect integration. 

Theorem 1.1. We have 

(1.1) / Yl \L(uj x <j),l+it)\ 2 dt<^T 



3+e 



Tl S T<tj<2T 
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Remarks. 

• The conductor of \L(uj X (f>, | +it) | 2 is x T 12 , so that the convexity bound is recovered 
above using the method of Heath-Brown (Lemma 3 of |H-B] ). 

• An easy consequence of Theorem 11.11 is that for "almost all" tj, 

/ T l-e 
\L( Uj x <j>,\ + it)\ 2 dt < T 1+£ . 

• The reason t is slightly smaller than T is to avoid the intricate dependence of the 
conductor on tj, though for t = tj see the companion paper [Yj. 

• The method of proof can also handle the analogous twists in the weight aspect by 
classical holomorphic modular forms on the full modular group; see Section 8 of [ILSJ. 

• The combined t-integral and spectral sum is reminiscent of Sarnak's work on the 
fourth moment of Grossencharacter L-functions |S2j . 

• Diaconu, Garrett, and Goldfeld (personal communication) have generalized the 
method of Good |Gooj to capture quantities of the form (11.11) . but with certain 
weight functions (depending on tj) in the integral. It is difficult to asymptotically 
evaluate these weight functions, so it is unknown what this implies about (11. ip . 

• A. Venkatesh posed this problem during a problem session at the October 2006 AIM 
workshop on the subconvexity problem. 

A natural way to attack this problem is with a hybrid large sieve inequality of the form 

2 

dt < A(N,T, U)(NTU) £ ^ Kl 2 - 

n<N 

A simple application of Iwaniec's spectral large sieve [Iwl] shows A(N, T,U) <C U (N + T 2 ), 
and one would like to replace this by iV + UT 2 . However, this appears to be an extremely 
difficult problem, and in fact in this generality it essentially implies the Ramanujan-Petersson 
conjecture for Maass forms! (To see this, take U large to pick out the diagonal only on the 
left hand side and choose a n to select n = N only, showing \Xj(N)\ 2 <C T 2 (TN) 6 <Cj N £ .) 
One might even consider a simpler problem where U has restricted size (say U < T) and N is 
large with respect to T. Even this seems to be a difficult and highly interesting problem (in 
my opinion). The state of affairs here for GL(2) harmonics is quite different than for GL(1) 
(multiplicative characters), where we do have the essentially optimal result of Gallagher [Ga] 

2 

dt < {N + UQ 2 ) K\ 2 - 

n<N 

The difficulty of estimating (11.21) for general coefficients barrier in our problem, 

which requires good estimates when the specialized to be coefficients of a GL(3) 

L-function. However, we have more available tools for these specific choices of coefficients, 
and in particular the GL(3) Voronoi summation formula plays a key role. X. Li [Lilj |Li2j 
showed how this summation formula can be very powerful in the study of this family, but an 
attempt to directly generalize her approach on the first moment meets extreme difficulties 
with the second moment (see the first few sentences of Section [6] below). 

In our companion paper [Y], we considered this family of L-functions at the special point 
~+itj. There are some similarities between the two problems but each requires substantially 
different ideas. In particular, the analog of one of the key ideas in [Y] (namely, Poisson 
summation in the variable a modulo b in (16.31) below) is not used here as it turned out to 
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not be substantially helpful, despite my strenuous efforts. Another major difference between 
these works is that in [Y] we were able to appeal to some large sieve inequalities due to |Luj 
(after [Delj ). which we improved further, while here we could not use anything of the form 
(II. 2ft . Furthermore, the conductors of the family of T 2 elements in [Y] have size T 6 (the cube 
of the number of elements in the family as opposed to the fourth power appearing here), 
which has the effect that the GL(3) Voronoi summation formula is relatively less powerful 
in this article than in the companion. Indeed, the dual sum after Voronoi summation had 
essentially no length! (Though it should be stressed that this feature only occurred due 
to our improvement on the relevant large sieve inequality.) This paper is almost entirely 
independent of [Yj (at the cost of some repetition), though in two places we refer to it for 
self-contained proofs of facts that are likely to be unsurprising to an expert. 

1.1. Acknowledgements. I would like to thank Brian Conrey, Adrian Diaconu, Xiaoqing 
Li, Peter Sarnak, and Akshay Venkatesh for interesting discussions. 

2. Notation 

See |Gol] for the material and notation on GL(3) Maass forms. Suppose is a Maass form 
for SL(3, Z) of type {yi, z^) G C 2 which is an eigenfunction of all the Hecke operators. The 
Godement-Jacquet L-function associated to is 

(2.1) L(0, 8 ) = = II( 1 - Mhp)p- S + A(p, l)p- 2s - p-'T 1 - 

71=1 p 

Here A(m,n) are the Fourier coefficients normalized as in [Gol] . In particular, A(l, 1) = 1 
and A(m,n) are constant on average (see Remark 12.1.8 of |Gol] ) . The dual Maass form 
is of type (z^^i) and has A(n,m) = A(m,n) as its (m, n)-th Fourier coefficient, whence 
L (<f, s ) = J2n=i A ( n > 1 ) n ~ S - Letting 

(2.2) v n „( s ) = n~>-»T ( s + 1 -f'-" 2 ) r (i±^) r ( lzl±Jl±j!» 

the functional equation for L(0, s) reads 

(2.3) T VuV2 {s)L(<f>, s) = r, 2M (l - s)L(0, 1 - s). 

Let (uj) be an orthonormal basis of Hecke-Maass cusp forms on SL(2, Z) with correspond- 
ing Laplace eigenvalues \ + Let Xj(n) be the Hecke eigenvalue of the rz-th Hecke operator 
for the form Uj. Since the Hecke operators on GL{2) are self-adjoint, the Aj(n)'s are real. 
Then L(iij, s) = Y^=x Aj(n)n~ s satisfies a functional equation relating to L(uj, 1 — s). 

As explained in Chapter 12.2 of [Golj . the Rankin- Selberg convolution of and Uj is 



(2.4) L( Uj x 0, 8 ) = J2 



Xj(n)A(m, n) 



(m 2 n) 



m,n=l 

The completed L-function associated to L(uj x 0, s), for Uj even, takes the form 



(2.5) A(uj x 0, a) = 7r~ Y [ j \ V j—Z \ Y ^ } 

s + itj — a\fs + itj—/3\fs + itj— r }' 



L(uj x 
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where a = —V\ — 2u 2 + 1, (3 — —V\ + u 2 , and 7 = 2z/ x + v 2 — 1 (see Theorem 12.3.6 of jGol] 
for the explicit gamma factors). Then this Rankin- Selberg convolution has a holomorphic 
continuation to s G C and satisfies the functional equation 

(2.6) A(uj x <fi, s) — A(uj x 0, 1 — s). 

The case with Uj odd is similar, having slightly different constants a, (3, 7. 

3. Basic tools 

3.1. Approximate functional equation. We shall use an approximate functional equa- 
tion to represent the values of L-functions. Write X u x ^(n) for the coefficient of n~ s in the 
Dirichlet series ( 12. 4ft for L(v,j x 0, s). Then Theorem 5.3 of [IK] says 

(3.1) nu, x 1 + «) = yj ^M n+jl(n ) + £t 53 W!>k (n) , 

where K(|/) and V*(y) are certain explicit smooth functions, and is a certain complex 
number of absolute value 1. The weight function Vi +it (x) has rapid decay once n 3> t 3+e , 
on use of Stirling's approximation. More precisely, 

(3 ' 2) K *« W = ^V wv is - 

where A(iij x 0, s) = r y{s)L{uj x 0, s) and G(s) is an entire function with rapid decay in the 
imaginary direction. Here V*_ it has a similar form to Vi +it but with 7(5) replaced by 7*(s), 

where A(u 3 - x 0, s) = 7*(s)L(wj x 0, s). 

3.2. The large sieve. The classical large sieve inequality for Farey fractions states 



(3-3) £ £ 

6<B a: (mod 6) 



) N<m<N+M 

(i,6)=l 



2 

<(5 2 + M) £ | Or. 

N<m<N+M 



For our purposes we require an additional oscillatory integral in the spirit of |Gaj . but we 
could not find the following result in the literature. For a self-contained proof, see [Y] . 

Lemma 3.1. Let /(?/) 6e a continuously differentiable function on [N, N + M\ such that f 
does not vanish. Let X = swp y e[N,N+M] \f\y)\ • Then for any complex numbers b m , 

2 



(3-4) fE E 



b<B x (mod b) 
(x,b)=l 



N<m<N+M 



dt^(B 2 T + X) I 6 ™ I 

N<m<N+M 



3.3. Kuznetsov formula. Our tool for summing over the spectrum is the following. 

Lemma 3.2 (Kuznetsov). Suppose that h is holmorphic in the region \Im(r)\ < | + 5 and 
satisfies h(r) = h(—r) and \h(r)\ <C (1 + |?"D~ 2 ~' 5 for some 5 > 0. Then 



oo 



_., . . x , 5(m, n; c) * / AnJmn 
7i o m=n I r tanh(7rr)/i(r)ar + / ft 



c=l 
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where 
(3.6) 



h(x) 



2i 

71 



rh(r) 



-J 2 ir(x)dr. 



-oo cosh(Trr) 
4. Initial cleaning 
Using a method similar to that of Section 5 of [Y], we reduce the estimation of (II. ip to 



(4.1) 



H 



9 



A, 



X(f> 



n 



-w 



dt, 



where the new notation is as follows: g is a nonnegative, even, Schwartz function satisfying 



l-e. 



\pjW\' 



g(t) > 1 for \t\ < 1 whose Fourier transform is compactly supported; U = T' atj — cosh ^ nt .^ ■ 
h is any nonnegative function > 1 for T < t < 2T; w is a fixed smooth, compactly supported 
function on R + ; and P <C T 3+£ . Recall that tj £ ctj t £ due to [HL] and [Iw2] . Because 
of interest in the subconvexity problem, it is desirable to obtain results where U = T 1 ^ 5 for 
some fixed 5 > 0. As such, we shall not specialize U = T x ~ e yet. 

Writing \ UjX ^(n) in terms of Xj(n) and A(l,n) using (12.41) . and using Cauchy's inequality 
to the sum over /, we get that 



(4.2) H « logP rlHl ' Hl = 9 (if) 

i«vp J -°° V J 

where = P/l 2 . We will show 



E 



ctjh(tj 



E 



\j(n)A(l,ri) 



n -2- 



-w — 



dt. 



(4.3) 



l~ X Hi « T 3+£ 



\Mhn)l 
In 



Using the polynomial growth of the Rankin- Selberg convolution L(0 x 0, s), one can show 
that the inner sum over I and n in (14.31) is bounded by logT (see Remark 12.1.8 of [Gol]). 

One of the basic techniques used throughout this paper is to apply an asymptotic expansion 
to a particular quantity and reduce the estimation of the entire quantity to that of the 
leading-order term, as the lower-order terms have all the essential characteristics of the main 
term yet are of smaller magnitude. 

5. Applying the Kuznetsov formula 

Our first step in estimating Hi is to apply Lemma 13.21 It is a somewhat involved task 
to analyze the integral transform h, but Jutila and Motohashi [JMj have obtained a precise 
asymptotic expansion of h for the particular choice 



(5.1) 



h(r) 



J^2 



exp 




cxp 




where we take A = T 1 e . Then by (3.19) of [JMj . we obtain an asymptotic expansion for 
h(x) with leading term 



(5.2) 



AT exp — 



cos [x — IT x + 



7T 



It suffices to only treat the leading term since the lower-order terms have the same form as 
the leading term but are smaller. 
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Let ii/^A be the same expression as Hi but with the choice of h given by (15.11) . so that Hi 
is the sum of <C T £ sums of the form Hi^ with T replaced by T + A, T + 2A, etc. Applying 
the Kuznetsov formula gives that 

(5.3) Hi a + Eisenstein = D% + K h 

say, where Di corresponds to the diagonal term and K\ is the sum of Kloosterman sums. 
The Eisenstein contribution is nonnegative and can be discarded for purposes of estimation 
of Hi } a- An easy computation gives 

(5.4) Di « UAT V 

z — ' n 

n<JV 

which is sufficient in view of the goal (|4.3|) . Inserting the asymptotic expansion for h(x) and 
letting Ki q be the leading term of Ki gives that 

^ « % D(h) ^mt± s -^< m m • 

where a m = A(l, m)m~^w 2 (^); ^2 is a certain smooth, compactly supported function; and 
Wi(x) is a smooth function on R + with rapid decay as x — > oo. Note that the case of the 
opposite phase can be reduced to an expression of this form. 

6. DlOPHANTINE APPROXIMATION 

The extreme oscillation of the term e ^ ~ 2 V™^ j s a source of difficulty in exploiting cancel- 
lation in the sum over m. For instance, an application of the GL(3) Voronoi formula would 
lead to a sum where the dual variable has size ~ T 6 (for "typical" choices of the parame- 
ters), which is a catastrophic loss (though there turns out to be a gain in the simplicity of 
the arithmetical properties of the new sum). It seems necessary to somehow dampen the 
oscillations of this exponential. To do so, note that the t-integral forces m and n to be close: 
essentially m = n(l + 0(t/ -1 )), so that the identity — = — m — n + {^/m — \fn) 2 
implies a close approximation (note that (\Jm — \/n) 2 <C (m — n) 2 /N <^ NU~ 2 ). Although 

e ( m ~ n ) is just as oscillatory as e ^ ~ 2 v^™- j (meaning the arguments of the exponential are 
of the same order of magnitude), it has the property of being periodic in m and n modulo c 
so that one can treat this term arithmetically and absorb the "remainder" e ^ IvjEzyjD j i n ^ 
the weight function, which is much less oscillatory. This is the main new idea in this paper. 
Another pleasant feature of e ( ~ m ~ n ) is that m and n are naturally separated. However, 
this "twisting" of the Kloosterman sum by the exponential e ( ~ m ~ n ) has the side effect of 

creating terms of the form e ( ^ h ~^ m \ where h is coprime to c, so that it does not always 

hold that /i — 1 is coprime to c (thus making the use of the large sieve inequalities or Voronoi 
summation problematic). Naturally one can factor out the greatest common divisor of h — 1 
and c to proceed further; that is the content of the following 

Lemma 6.1. For all integers m, n, and positive integers c, we have 

f-m-n\ ^ ^ fxm- (x + a)n\ 
(6.1) S(m,n;c)e\ 1=2^ 2^ e ( ~ h )' 

^ ' ab=c x (mod ft) ^ ' 

(x(x+a),b)=l 
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Remark. This calculation seems to have been first performed by Luo |Luj . but see also 
[PL~] for some curious connections. 

Proof. By opening the Kloosterman sum, we get that the left hand side of (16. ip is 

V- J{h-l)m+(h-l)n 



E ■ 

h (mod c) 
(h,c)=l 

Write (h — 1, c) = a, c — ab, and change variables h = 1 + ax (mod c) where now x runs 
modulo 6 and satisfies (x(l + ax), 6) = 1. Note that 1 + ax — 1 = — ax(l + ax) (mod 6). 
Replacing x by x gives (16.11) . □ 

Inserting (16. ip into (15.51) gives 



(6.3) 

where 
(6.4) 

Let 
(6.5) 

so that 
(6.6) 



AT x ^ 1 

a,b x (mod b) rn,n 

(x(x+a),b)=l 



E E 



am.a n e 



xm — (x + a)n 



Z(m, n), 



iT £ ab 

Z(m, n) = e 27T ^" 



Wi 



/a6AT\ /(v^-v^) 2 \ r 
\ \Jmn J \ ab J J- 



9 a) r?r*. 



U \nJ 



^ = E 



f xm — (x + a)n 

amQ j n& 



Z(m, n), 



AT 



N 



E 



E 



ITI- 



x (mod b) 
(x(x+a),b)=l 



7. Separation of variables 

Next we want to separate the variables m and n in Z(m,n), for which we shall use 
oscillatory integral transforms. This will allow us to express J in terms of a bilinear form so 
that we can apply the powerful technology of the large sieve. We will show in this section 
that J = JT Jj is the sum of T £ terms of the same form (plus a negligible error term), 
with leading-order term, say Ji, satisfying 



(7.1) 



\Ji\ <-T e 



E, xm 
a m e( — 



m lv e 



uWm 



UVab 



du. 



for some t)<T £ . Write |i^,o| "C \Kij\ corresponding to this expansion of J; it suffices to 
treat the leading-order term, say Ki t \. Applying Cauchy's inequality and changing variables, 
we obtain the following 



Proposition 7.1. We have 



(7.2) 



Ku < AT 



l+e 



E 



ab 



ab<^ 



E 



n<l x ( mod b ) 
(x,b)=l 



E 



a m 6 



xm 
IT 



m lv e 



u 



Uab 



du. 
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We shall use different methods of estimation depending on the sizes of a and b. Let 
Ki(A,B) denote the same sum as K^i but with A < a < 2A and B < b < 2B, where 
AB <C ^37F- By summing trivially over a, note that 

2 



(7.3) 



K 1 {A,B)<^T 



AT 
~B~ 



E E 



u<l i, "- Bl ( mod h ) 
(x,b)=l 



d m 6 



~b~ 



u\/mN \ 
UAB 



du. 



We can immediately apply Lemma 13.11 to get 

(7.4) Ki(A, B) < T £ AT(B + UA) ^ |a m | 2 < T £ + T 2 f/^) J] 



m<N 



This estimate is sufficient for H4.3[) only for A small (i < (7 1 T 1+e ), though it simplifies 
some later work. Also, notice that we used no properties of the coefficients a m so far. 

iT 2 ab 

Proof of (17.11) . We will separate the variables in e 2 ^^™™ first using a short Mellin integral, 
and then use a more involved argument for the remaining expression. 

First attach a smooth, compactly-supported weight function w^(^mn/N) to Z(m,n) that 
takes the value 1 for all m and n in the support of the implicit weight function appearing in 
a m a^. Then by Mellin inversion we obtain 



(7.5) 

where 
(7.6) 



i^ ab fabAT\ f Jmn\ 1 f°° 

2 ^ nwi [v^ ) W3 l^r ) = ^ a ' b ' A 

fabAT\ 



T,N{ W 



N 



'mn 



dv. 



F a hAT,N(iv) 



V Nx J 

If |f | ^> T e then repeated integration by parts shows F(iv) is negligible (meaning smaller 
than any negative power of T). For \v\ -C T £ , a trivial bound shows F(iv) <C 1. 

Next we separate variables in 
(7.7) 

Zl (m,n) :=e Av^-v^) 2 



ab 



9 



in 



n 



dt 



m — \fn)' 



ab 



??? 



n 



Recalling that fj has compact support, which restricts m and n so that |m — n\ <C U~ 1 N, 
we can then use a Taylor expansion to write 

2 



(7.8) 

noting 
(7.9) 
/ U 



log 



m 



71 



log 1 



m — \/n 



ri 



\pm — y/n 1 / \pm — y/n 
2 



/7 



+ . . . 



< [/ x . Then we get an asymptotic expansion for ~g in the form 



- I ' ■ i m 
y 27T n 



9 



2tt 



m 



n 



9 



2tt 



+ .... 



Note that each successive term has the same form as the leading term, but is smaller, so we 
shall only treat the leading term in what follows. 
Thus it suffices to consider 



(7.10) 



Z 2 (m, n) = e 



ab 



Uwa U 



n 
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where W4 is smooth and compactly supported. Let z = , and Z = ^y^g, so 

(7.11) Z 2 (m,n) = Ue(z 2 )w,^y 

Suppose Z ^> T e (in our application this is always satisfied since ab <C (AT)~ 1+e N, A = 

T 1_£ , and U <C T 1 ~ e ). Then by Fourier inversion, 

(7-12) 

Z 2 (m,n) = I Y(u)e ( — — — — J c?w, where V(u) —u[ e(z 2 — uz)w 4 (—} dz 

J-oo V Vfl6 / i-oo ^ 7 



Next we apply the Plancherel formula f(x)'g(x)dx = J™ f(y)g(y)dy, with inspiration 
here from pp. 431-432 of |Slj . We have 



(7.13) Y(u) = ^-UZ f e {- fH±»y ) wl(-yZ)dy. 



Expanding the square, we get 

(7.14) Y(u) = V2e™ / *UZe(^pj J e (-y 2 - uy)wi(-2yZ)dy. 

Next truncate the integral at T~ £ (with negligible error), expand e(—y 2 ) into a Taylor series 
taking 0(T e ) terms so that the remainder is 0(T~ 2009 ), and then extend the integral back 
to M. This gives an asymptotic expansion for Y(u), with leading-order term say Y± given by 
(7-15) 

Y 1 (u) = V2e«' A UZe (^f\ J™ e{-uy)w,{-2yZ)dy = U^jte f^f) w, (^) . 
The lower-order terms are of a similar shape, but smaller. Thus we conclude that 
(7.16) Z 2 (m, n) „ J e {—) m (_) e ( ^ ) *■ 



Hence we get an asymptotic expansion for J with leading-order term J\ of the form 



(7-17) | Ji| < 



/ / ^ a m a n {mn) 2 Wi e ^ 



dudv. 



Using Cauchy's inequality and estimating the v -integral by the supremum, we get (17. II) . □ 

8. VORONOI SUMMATION 

In order to improve on (17.41) we resort to use special properties of the coefficients a n . Our 
tool is the GL(3) Voronoi summation formula proved by [MS]. We will state this important 
formula in a form developed by X. Li [ Lilj . 

Theorem 8.1 (Miller-Schmid) . Let ip be a smooth function with compact support on the 
positive reals. Then 

5 



n v 7 m[6«n2>o 1 z v 17 v 7 

67r _ f >r-^ >r-^ A(n 2 , rii) / ^ \ T / n 2 n? \ 



n\\bl n,2>0 
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for certain integral transforms \&i and $?2- 

We need an explicit asymptotic expansion of and ^2, which is provided by Lemma 6.1 
of [Li2j ( generalizing of Lemma 3 of Ivic [Iv]). Each of and ^2 is a linear combination of 
two other functions ^o{%) and x~ 1 ^/o,o{x), say, where each has similar asymptotic behavior, 
so it suffices to treat ^ot^)- 

Lemma 8.2 (Ivic, Li). Suppose ip(x) is supported on [N,2N]. Then there exist constants 
Cj t ± such that 

(8.2) %(x) = E E c ^ x 1°° me(±3(xy)^) + O ((xN)^ 

An easy contour shift argument shows that ^o(x) has rapid decay for xN — > 0, and is 
bounded for xN <C 1 (see the original expression (6.12) of [Li2j ). 
Write (17. 3p in the form 

(8.3) k 1 (A,5)«— — / E \V(u-x,b)\ 2 du, 



M<1 



6xB x (mod 6) 
(x,b)=l 



where 



(8.4) V(u- *, 1) = AT* £ Ml, ra)e (^) m <«e Q , 

and where u>s(x) = x~^W2(x). Applying the Voronoi summation formula to V(u;x, b) 
with ip(y) = y lv e (^9aZt) w ${n)-> we obtain V(u;x, b) = Vi(u;x,b) + V2(u;x, b), say, cor- 
responding to the two terms on the right hand side of ( 18. lft . We accordingly write 
Ki(A, B) < K 1A (A, B) + K lt2 (A, B). Changing variables by x -> -x shows that K 1>2 (A, B) 
is of a form similar to that of Ki^A, B), so we shall henceforth only treat Ki t i(A, B). 
First we claim we may assume xN 3> T £ . Otherwise, using b -C ^f?, then 

h 3 l N 2 1 

(8.5) n\ri2 « b 4 « T £ 



N A 3 T 6 

Recalling that N < T 3+e // 2 , we get that n\n 2 < ^3. Thus, if A > T £ , then this condition 
is never satisfied. We already covered the case i < T £ with (I7.4p (since all the variables 
rii, n 2 , 1 are small it would be easy to treat this case directly too). 

Since xN 3> T e , Lemma [8.21 gives an asymptotic expansion of V\. As usual, we treat the 
leading-order term, say K 0Q (A, B), which takes the form 
(8.6) 



u< e-± b^B x (mod b) 
(x,b)=l 

where Q(x) is a function of the form 



ni \bln 2 >0 



2 

du, 



(8.7) 4( ^_L.^ m (|),v(-3,.,)- + 9f)^ 
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with w some smooth, compactly-supported function on the positive reals, and v <C T £ , 
possibly after changing variables u — ► — u or d ^ — v. The change of variables y — ► A^y gives 

(8.8) $(x) = -^=( x Nf 3 N iv u^y-i^e (-3(*yA0 1/3 + dy. 



Our plan now is to express Kq^(A, B) into a form where we can apply Lemma I3.lt the 
u-integral is critical for an extra saving effect, and as such it is important to understand the 
phase of the integral transform $ (not just its magnitude). 

9. Asymptotic behavior of $(x) 

Under the assumption xN 3> T £ (with v <C T £ / 100 , say), the first term in the exponential 
in (18. 8p dominates over the phase of y w . Unless the two terms in the exponential are of 
the same order of magnitude and of opposite signs (in particular, u must be positive), then 
an easy integration by parts argument shows that $(x) is negligible (smaller than y~ 2009 ). 
That is, $(x) is small unless 

u 3 N 2 

Now suppose (19.11) holds. 

We shall treat general integrals of the form 

/>oo 

(9.2) /= / g{y)e{ay 1 ' 2 - ^)dy, 



where a, (3 > 0, a x f3, and g satisfies 

(9.3) g is smooth of compact support on IR + , satisfying g^\y) <C Tq , 

for some parameter 1 < To <C | o- 1 i/ioo _ rj^g stationary phase method easily gives the main 
term for J, but a search of the literature did not find an adequate asymptotic expansion. In 
this section we show that / has an asymptotic expansion with leading term equal to 

9.4 I ^sl> 

(20* 

and where the lower-order terms have the same phase, but are smaller by powers of a. 
Applying (19.41) to $, we find that 

(9.5) 0W .^(«)e(=^) 

where h is a smooth function of compact support on IR + , with bounded derivatives, and 
z(N,U, A, B) is some bounded function (not depending on either u or x). Noting byfx = 
\/ n i n 2—hr and inserting this expression into (18.61) . we obtain 




(9.6) K 0fi (A,B)^— — / E 



B 



Y b>iB x (mod b) 
(x,b)=l 



^ ^ A(n 2 , ni ) S |) . f{UABfn 2 n\\ ( -An 2 n\(U AB)~ x 



1^ 1^ r^- 2 ni h { u 3 6 3 /iV 2 J e { u 2 hHN ) ( n i n 



2) 



du. 
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We will continue with this expression in the following section. 

Proof of (19.41) . Our goal is to use known properties of the Airy function, using ideas similar 
to those appearing in Section [71 First apply the change of variables y = t 6 to get 



(9.7) /= / h(t)e(af - (3t z )dt, 

Jo 

where h(t) = g(t 6 )(6t 5 ) satisfies We will show 

9.8 / r e — + - )h — 

1 ' (2/3)* V27« 2 8 J \3a 

which immediately implies (19.41) . 

Next change variables t — > t + (3/ (3a) to get 

Now use Plancherel with h a ,/3it) = h(t + ^) (again, h a ^ satisfies (19.31) except its support 
may include negative reals) to get 



Note 



, \ ,. 2 f°° ( 1 3 o _ £ + i 



(9 - n) L e r 3 - ( fe + % J dy = (6^75 y o - ( / - 2 - (&^ i ^ 

which is 

(9.12) — ^— Ai | -27T , 55 ti / , 
v ; (671a) 1 / 3 \ (Qua) 1 /* 

where Ai(x) is the Airy function. Thus 



27r f-23 3 \ r°° - - / @- + t 



(67TO;) 1 / 3 



dt. 



Next change variables by t — > f-t to get 



2* J-20>\ rP 2 r~f „_&(!+«) 



(9 - 14 > 7 = (6^yw e (27^ J s> (-i; ( J Ai {^ftw 1 *■ 

Next we insert the asymptotic expansion for the Airy function at large negative argument 
(see (4.07) of [U]), namely 



(9.15) Ai(-x) 



cos ( -x^ ~-)y^: + sm( -x^ --)Y 4^ 
V3 A J ^ x 3k \3 A J 4^ xi( 2fc+1 ) 
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for certain explicit constants Cfc (in particular, c = 0). Thus 



<•■« -^,-(iS)££c(-£.) ^:;:;„. 

(67ra) 1 /3 ) 

where the lower-order terms have a similar shape but are multiplied by powers of ^(1 + 
^-3/2 x q,-!^ _|_£)-3/2_ ^- erms w i^h cos replaced by sin are treated similarly, so we work 
with cos only. This expression simplifies as 
(9-17) 

T 25 /-2/3 3 \ f°° 02 / 0i \ U / 27r g(i+t) x 



P 



i /-2/3 3 \ f°° 02 / ^2 \ / 2 /27rf-(l + t 




The usual integration by parts argument shows h a ^{x) <C (— ) for any If > 0. Thus we 

2 1 

may truncate the integral at t <C a~s at no cost, and expand (1 + 1)* into a Taylor series. 
Now write cos a; = \{e %x + e~ lx ), and write 7 ~ I + + 7_ correspondingly. Thus 

V ; ~ (2/3)3 \27a 2 J J_ a -ys3a a ' P \ 3a J \ \27a 2K J 8jJ 

Next we take a Taylor series for (1 + 1) 3 ^ 2 = 1 + |t + . . . in the exponential. The quadratic 
and higher terms are small (much less than 1) so we take a Taylor series expansion for the 
exponential of these terms, giving another asymptotic expansion with leading-order term 

1 ; (2/3)3 V 27a 2 JJ_ a -vs3a a ' p \ 3a J \ \9a 2 J J 

Extending the integral back to R and changing variables back via t gives 

Calculating the integral in terms of h, we get 

(9.21) I^ e Me(^P±)h a J T £). 
K ' (2/3)3 V 27a 2 J a3 y3a) 

Note h a £ (t-^.) = h (^(1 =F 1)) • Since h has support on the positive reals, we have h(0) = 0, 
in which case only J_ contributes to I, so then 

(9.22) I ^Jl^l + i) h ( 2 l). 

(2/3)* V27a2 8^ ^7 

One easily checks that this is the expected main term one obtains from stationary phase. □ 
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10. Cleaning 



We have reduced the problem of estimating K\ (originally given by ( 15. 31) ) to estimat- 
ing the rather messy expression K Q0 (A,B) given by (19.61) . in the sense that any bound 
on sup A B K fi(A, B), times T £ , is also a bound for K\ (recall that the supremum is over 
1 <C AB <C T~ 2+e N). We shall make some preliminary transformations to clean up this 
expression. The reader interested in the essential details should consider the crucial case 
u x 1, I — ni — 1, which greatly simplifies the forthcoming calculations. 

As a first step, apply Cauchy's inequality to take the sum over n\\bl outside the absolute 
values, and divide up the sum over n 2 into dyadic intervals n 2 x N 2 , where in view of (19. ip . 

IN 2 

(10.1) N 2 « — 



Thus 
(10.2) 



n 2 {UAf 



.AT 



K 0fi (A,B)«T^Yl E £^> 

fcxB x (mod b) ni\bl 
(x,b)=l 



where, for certain complex numbers a(nx,n 2 ) with the same absolute value as A(n 2 ,rii) 



(10.3) K' 



E 



S (lx,n 2 ; |0 ({UABfn 2 n\\ (An 2 n\{UAB) 



^n x n 2 



V u 3 bHN 2 ) 



l bHN 



du. 



Next, locate the remaining variables in dyadic segments, say I x L and n\ x JVi. For such Z 
and ni, change variables in u via 



(10.4) 
to get 

(10.5) 



u 



uab 3 ' 2 nI'\T , 



53/2/1/3^2/3 



/2 



ir' < w 



liXl 



E 

U2XN2 



a[nx,n 2 



S (/ar,w 2 ;^) / 



™2 



V45 y iV 2 



V n l n 2 

where the restriction to m x 1 is redundant to the support of /i, and 
(10.6) W = N \.? Ll/ \ W 



un 2 \ 
WJ 



du. 



UAN 2 /3 N* /3 



N 2 / 3 N l/3 



£1/3^2/3 



Next separate the variables „, n 2 , and 6 in h (ft )« f) by nsing the Mellin inversion 

formula; since it is already located to be x 1 and n 2 x N 2 , this can be done at no cost 
(redefining a(ni,n 2 ) as necessary). Then we obtain that J^i-l^i is bounded by sup/C, 
say, where the supremum is over the the various parameters A,B,Ni, etc. satisfying the 
already- imposed constraints (such as NL 2 <C T 3+£ ), and where 

/ \ 2 

;io.7) k=i^^x;e x; e ' ^ aK, " 2: 



ZxL fix B z (mod 6) ni|6Z ux j 
(b,6)=1 nixAf : 



E 



y/nin 2 



un 2 

w 



du. 
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We now proceed to estimate /C given by (110.71) . Let d = (b,rii) and change variables 
b — > db, ni dn\ to get 
(11.1) 

a(dn 1 ,n 2 ) ^ i} x ' n<2 ' nT 



V dri\n 2 



(un 2 \ 

e tw) 



du. 



K« r 'fxE/EE E E E 

/xL u"l d<B 6xB/d x (mod bd) m\l n 2 
(x,bd)=l (ni,6)=l 

Write ^- = rs where r|6°° (meaning all primes dividing r also divide b) and (s, b) = 1. Next 
change variables to eliminate I and note that the sum over x only depends modulo b to give 

:„. 2) ic«t^ / E d E E E^. 



5 L 



d (nis,6)=l 



where 
(11.3) 



K.= E 



x (mod b) 
(x,6)=l 



Ea(dn 1 ,n 2 ) , . fun 2 \ 



Next we simplify Ki, by showing 
(11.4) /Ci < 6r 2 s J^* 

/i (mod fcs) 



^dr^ 6 \bs ) e \W ) 

r\n2 



Proof of flll.4p . From the multiplicativity relation for Kloosterman sums, we obtain 
(11.5) ' 

S (nirsx, n 2 \ brs) = S(riirssx, n 2 s, br)S(nirsbrx, n 2 br; s) = S(nirsx, n 2 , br)S(Q, n 2 ; s), 

which becomes S(rx, n 2 ; br)S(0, n 2 ; s) after the change of variables x — > sW[x (recall n\ is 
coprime to br). Thus 

2 



11.6) 1Ci= Y, 



x (mod 6) 
(x,b)=l 



b m S (rx, m; br) 



a(dm,m) um\ 
with b m = — - S (0, m; s)e — 
y/drum \W J 



Next we compute for arbitrary complex numbers c n 



11.7) 



E 

x (mod 6) 



c mS(rx, m; br) 



, \- \ - (h\m\ - h 2 m 2 \ 



mi .m2 



hi ,/i2 (mod 6r) 
h\=h,2 (mod 6) 



Change variables via hi = y + bzi, i = 1,2, where y runs modulo b and runs modulo 
r. Since r|6°°, the condition that (hi,br) = 1 is equivalent to (y,b) = 1. The sum over Zj 
vanishes unless r\rrii, in which case the sum is r. Thus (I11.7P equals 

2 

b 



11.8) 



br c mi c m2 ^ ^ ( 

r\mi,rri2 y (mod b) 



y (mod b) 



r\m 
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11.9) Ei < br 2 Y^* 

y (mod fe) 



r\m 



S(0, m; s) 



, with c n 



a(drii,m) /um\ 
^dn x m \W J 



By Cauchy's inequality, we get for any complex coefficients b m that 



11.10) 



^E 

h (mod s) 

Note that S(m, 0; s) = S(- } 0; s) since (r, s) = 1. Hence 



s / 



11.11) 



Ei < 6r 2 , 

h (mod s)y (mod b) 



r\m 



e 



which gives (jll.4p using the Chinese remainder theorem. 

Picking back up the chain of reasoning, we insert (111.41) into (111.21) . getting 
(11.12) 



□ 



K < T 



AT W 
~B~L 



, E d E E E r E 

a!<CA r i fo" nirsxL rife 00 y (mod 6s) 
d (nis,6)=l 
drcixTVi 



E 

r|rt2 



a(dn 1 ,n 2 ) ( ' U I f\ (un 2 \ 



^d^T 2 6 \bs ) e \w) 



Next relax the condition that r|6°° and for convenience locate the variable s x S, where 

NirS x dL. In addition change variables bs — > c, getting 

(11.13) 



E 



5 L 



E E" 



" r ^-BS-h (mod c) 



E 

r\n2 



a(dn u n 2 ) ( V~jr \ /wn 2 \ 



for some choice of parameters. Finally, an application of Lemma 13.11 gives 



11.1!) /c «r^^^d £ 



B L 



^ E ' E 



which is 
(11.15) 



<T 



.AT W ( B 2 S 2 



B S \ N\ 



L 712X^2 
"I s ?12=0 (mod r) 

|a(cini, n 2 ) | 2 
cinin 2 



|a(dni, n 2 )p 
dn-[Ti2 



Note that W < 1 from OUT]) , and that W'W = < 77^^. Thus the expression 

(111.151) simplifies as 



IBN 2 < 

JV — {UA) 2 N'( 



< T £ AT 55 + 



LN 

WW 



E 



11.16) 

\ ((-!!-/ 

Recalling that B < ^ and L 2 iV < T 3+£ gives that (flTT6l) is 

T 2 



|a(ni,n 2 )p 



11.17) 



:T 



3+e 
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This completes the proof of Theorem 11.11 by combining with (17.41) and setting U = T 1 £ . 
Notice that the case A = U~ 1 T is particularly interesting. 
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